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A study evaluated the effectiveness of the 1992-93 
Reading Recovery program as implemented in the Columbus Public 
Schools. The program featured individualized one-on-one lessons 
provided by 66 specially trained teachers serving 305 pupils. Data 
included results of administration of Metropolitan Achievement Tests 
and Scott Foresman text reading level testing. The treatment group 
consisted of the 162 pupils who were either discontinued (82) or 
received 60 or more lessons but not discontinued (80). Results 
indicated that: (1) 149 pupils (927.) reached Scott Foresman level 8; 
(2) 91.97. of the pupils were not retained in grade one; (3) 355 
different parents or guardians were involved in some way with the 
program; (4) 34 (21.87.) of the evaluation sample students reached the 
average normal curve equivalents (NCE) for the district as a whole; 
and (5) of the 368 pupils from the 1990-91, 1991-92, and 1992-93 
treatment groups who remained in the Columbus Public School, 90.57. 
(333) followed a normal grade-level progression. Findings suggest 
continuation of the program with attention given to seven 
recommendations. (Contains 13 tables of data. Survey and evaluation 
instruments are attached.) (RS) 
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Elementary and Secondary Education Act - Chapter 1 

FINAL EVALUATION REPORT 
READING RECOVERY™ PROGRAM 
1992-93 

ABSTRACT 

assessment of the pupil's development of reading and writing strategies. 

The Reading Recovery program was piioted in Columbus Pubfc Schoote^ the 198^5^ 
year with the 1992-93 school year being the ninth continuous yea of the .P^ram. The fffiSZ^gL ! 
£ eZrt of educators in the'columbus Public Schoote, the C^c^Edi^nof The OhtoStete 
University and the Ohio Department of Education and was funded by Elementary and S<»«KUuy 
EdSon (ESEA) - Chapter 1 monies. During 1992-93 the Reading Recovery program was tocatedin60 
^m^oL. hada staff of 66 teachers (16.5 PTEs) and sensed 305 pupils. Most teachers s«ved 
part-time in the program and part-time in the Eariy Literacy program. 

Tiinelnterval: For evaluation purposes the Reading Recovery program started on September 2M 9 9 2 »"J 
S^^ohMivU 1993 Pupils included in the final analyses for Desired Outcomesl and2must 

S Sctiona. lessons or have been successfully 
^program To be included in the analysis of standardized test achievement pop* must 
60 or^ra instructional lessons or have been successfully discontinued and have had a valid posttest 
score on a nationally standardized achievement test. 

Activities- To help pupils develop reading strategies, daily 30-minute individualized lessons included a 
vS^i in^L7activfties.Tuch as reading and re-reading books while the teacher recorded I *e.r 
sSies Tn^ermrs writing and reading their own stories, letter Mortification, and sound analyse of 
words. 

A^omant nhtective: Pupils were to recerve Reading Recovery instruction until they were /eadyto^be 
succeVsnvd i Siwe d from the program. Discontinued pupils were those who successfully completed 
Se^m aSSSS to (a) predefined levels on observational tasks indicating that f P£"» 
readKle averse level for the district, and (b) teacher judgment thatthe pup s had devetoped 
effective rending strategies and could laam in the normal classroom setting without extra indrvidual help. 
p ua i, ia tion nasinn: The evaluation design included two desired I outcomes: (1)< it ,' e ^J5 percent of tfw 
SKhoSeceived 60 or more lessons or were discontinued would not be retained; and (2) at least 50 
Sert oTplpils who received 60 or more lessons or were discontinued would read at least frve books at 
Sraading^evel 8 (appropriate Scott Foresman text reading level tor promotion to grade 2) or abom In 
ac^XtMhT Sro oSoutcomes, three evaluation questions were Included in the evaluate design 
oattTuSn ^major program goate: to develop and provide the Reading Recovery p^ramfo, JM 
grade chiklren. and to adopt and apply the necessary ^^^^^^U.^^T, 
asked in the following areas: (a) service patterns of puplle; (b) performance levels of Reading Recovery 
pupils on a standardized test of reading; and (c) long term effects. 

The major evaluation effort was to be accomplished through teacher evaluation of pupil ^ependert 
reading achievement and the administration of the Metrc^enAchlev^rt 
1985 (MAT6) for spring testing. Analyses of the faridardteed test data 
districtwide average NCE scores. Although not part of the evaluation design, parent ^em^da^was 
aS) collected by program teachers. Locally constructed Injrumerts were used to collect 
enrollment/attendance and parent involvemert data. District computer files were used for retention data. 
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Mate Pinriinns/Rpmmmflndations: The Reading Recovery program served 305 pupils in 1992-93, with 
^^^SZ7?UiaYS. Average pupil attendance was 66.7j days (and 
of insLcYtonal lessons was 55.2. The treatment group consfeted erf he 162 puprb wto^e^er 
discontinued (82) or received 60 or more lessons but not d«ccrtinued (80). Program ^*p« tave 
estimated that most pupils need approximately 60 lessons to «m|Metha 'J^^iSSSSi 
group pupils, 156 had valid MAT6 Total Reading scores, were English-speaking, and were included in the 

evaluation sample. 

Records of parent contacts and activities maintained by program teacher for the 305 pupite served 
indicated 355 different parents or guardians were involved in some program • Thwe355 

individuals made a total of 1080 contacts wrth program teachers. ^^^^J^P^ 
represented 53.1% of the 305 pupils served, but represented 68.7% (742) of the total number of contacts 
and 62.3% (221) of the individual parents involved in the program. 

The two desired outcomes for the 1992-93 Reading Recovery program were met Of the162puptein 
the treatment group, retention data were available for 160 pupils. Of ^^^*>3J 
not retained (criterion was 75.0%). Of the 162 treatment group pupils, 149 (92.0%) read five or more books 
at text reading level 8 or above (criterion was 50.0%). 

Thirty-four (21 .8%) of the evaluation sample pupils reached the average NCE (45.6) for the district as 
a whole. The percentages of pupils who were at various percentile levels on the posttest were asr follows: 
(a) 17.9% (28) were atthe 50%lle or above (grade level); and (b) 76.9% (120) were below the 37%.le and 
still eligible for Chapter 1 services. 

Results of the analyses of the long-term effects of Reading Recovery revealed the following. Of the 
former Reading Recovery pupils who were in a school and at a grade level where a compensatory 
education program was in operation in 1992-93, 36.4% (48) of the pupils from the 1990-91 treatment! jroup 
and 31 0% (36) of the pupils from the 1991-92 treatment group were still being served in a compensatory 
education program. Of the 368 pupils from the 1990-91, 1991-92, and 1992-93 treatment groups who 
remained in the Columbus Public School through November 1993, 90.5% (333) followed a normal grade- 
level progression. The retention rates for grade 1 were: 4.1% for the 1990-91 treatment group, 1.8% for 
the 1991-92 treatment group, 8.1% for the 1992-93 treatment group, and 5.0% for the three treatment 
groups combined. 

Based on evaluation results K is recommended that the Reading Recovery program be continued, with 
attention given to the following additional recommendations: (a) examining the process for discontinuing 
service to pupils; (b) exploring ways to reduce the amount of time program teachers spend with record 
keeping- (c) increasing parent involvement; (d) identifying pupils needing special education instaicton at 
the earliest possible date; (e) providing opportunities for coordination between the program and classroom 
teachers; (f) maintaining a viable inservice program for program teachers; and (g) establishing a stroctured 
process observation procedure. 
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FINAL EVALUATION REPORT 
READING RECOVERY™ PROGRAM . 
1992-93 

Program Description 

The purpose of the 1992-1993 Reading Recovery™ program was to provide early inteivenfon to 
underachieving first-grade pupils who appeared unlfcefy to team to read ^y^^^J^^ 
instruction. To accomplish this purpose the program featured ^^«f* <»*^™ JSKiJ 
minutes daily provided by specially trained teachers. The lessons were based upon obsewatoHUdtesks 
Si were destined to pro^Ta comprehensive assessment of the pupil's development of reading and 
writing strategies. 

The Reading Recovery program began in Columbus Public Schools <^ to 
with a pilot program at 6 schools, serving 70 pupils taught by 14 teachers. During 1992-93, the program 
served fpurflsaS schools, with a teaching staff of 66 teachers (16.5 FTEs-Full Time Equrvatents). Table 
1 shows staffing, wmber of schools, and pupils served for the nine years of the program s existence. 

Most Reading Recovery teachers were assigned individually to a building, working half the day in the 
Reading Recovery program and half the day in the Early Literacy program. Typically a program teacher 
taught three Reading Recovery pupils for 30 minutes each and four groups of six Early Literacy pupils for 
40-45 minutes each. 

In 1992-93 the Reading Recovery program was located in the following 60 elementary schools. 

Schools Served by the Reading Recovery Program 
1992-93 



Arlington Park 


Eastgate 


Avondale 


Easthaven 


Beck 


Fair 


Binns 


Fairmoor 


Broadleigh 


Fairwood 


Burroughs 


Fifth 


Cassady 


Franklinton 


Cedarwood 


Hamilton 


Clarfiek) 


Heyl 


Como 


Highland 


Dana 


Hubbard 


Deshler 


Hudson 


Eakin 


Huy 


East Columbus 


Innis 


East Linden 


Kent 


Schools were chosen for inclusion in 



Koebel 


Reeb 


Leawood 


Salem 


Lincoln Park 


Scottwood 


Lindbergh 


Second 


Linden 


Siebert 


Livingston 


South Mifflin 


Main 


Southwood 


Maize 


Stockbridge 


McGuffey 


Sullrvant 


Medary 


Trwitt 


Moler 


Weinland Park 


North Linden 


West Broad 


Ohio 


West Mound 


Parkmoor 


Westgate 


Pilgrim 


Windsor 



F & RPL are included in the program each year, with the total number of schools involved in the program for 
a given year determined by the availability of funding for that year. 

The 66 program teachers received support from three teacher leaders who served as trainers, 
resource teachers, program coordinators, and program teachers. The teacher leaders taught a retired 
credit course for the first-year Reading Recovery teachers (20 teachers out of 66) and provided inservfce 
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Table 1 

Staffing, Schools, and Pupils Served 
Reading Recovery™ Program 
Columbus Public Schools 
1984-1993 



School 
Year 


Teachers 


Teacher 
Full-Time 
Equivalents (FTE) 


Schools 


Pupils 
Served 


1984-85^ 


14 


7.0 


6 


70 


1985-86 


30 


16.0 


12 


224 


1986-87 


52 


26.0 


20 


335 


1987-88 


57»> 


29.0 


26 


393 


1988-89 


49" 


23.8 


26 


283 


1989-90 


66° 


29.0 


31 


51 4 d 


1990-91 


60° 


20.0 


38 


297 


1991-92 


48' 


13.0 


41 


227 


1992-93 


669 


16.5 


60 


305 


a Pilot year. 



b Plus support staff including 3 teacher leaders and 1 Ohio State University affiliated teacher. 

includes 5 teacher leaders and 3 teacher leaders-in-training. 

includes 1 50 pupils with group service only. 

•Includes 2 teacher leaders and 3 teacher leaders-in-training. 

includes 2 teacher leaders and 4 teacher leaders-in-training. 

includes 3 teacher leaders and 2 teacher leaders-in-training. 



EMC 



training for the experienced program teachers (41 teachers out of 66). Additionally, two of the 48 teachers 
received extended training to become future teacher leaders. Funding for the program was provided by 
Elementary and Secondary Education (ESEA) - Chapter 1 monies. 

At the beginning of the year, classroom teachers selected first-grade pupils who appeared to be most 
in need of reading help to take two reading and writing observational tasks: Concents Ahmtt Print and 
Dictation (see Appendix A, pp. 24-25), which are two of the observational tasks designed by Marie Clay 
(1979), developer of the Reading Recovery program. Scores from these two tasks were used to determine 
a pupil's Selection Score. Selection Scores of 76 or below (see Appendix B, p. 27) qualified pupils for 
Reading Recovery or Early Literacy program service, pupils with the lowest scores being served first. The 
typical program teacher served 27 pupils, three Reading Recovery pupils and 24 Earty Literacy pupils wt?h 
the three Reading Recovery pupils being the pupils with the lowest Selection Scores. After selection for the 
Reading Recovery program, pupils were administered four additional observational tasks: Lflttet 
Ident i fication . QhlQ Word Tfffil, Writing Vnnahiitiiry and Text BfladiM lft ™' These additional 
observational tasks were given to pupils to provide program teachers with more information about each 
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pupil before beginning program instruction. The six observational tasks were also administered at various 
times throughout the school year as pupils entered or exited the program and again at the conclusion of the 
program year. 

Each pupil enrolled for individual service in the program spent approximately the first 10 days 
"Roaming Around the Known." During this period the Reading Recovery teacher built rapport with the pupil 
and provided an opportunity for the pupil to use the strategies he or she already knew in meaningful 
reading and writing activities. Once the Reading Recovery lessons began, a familiar pattern was 
established. A typical 30-minute lesson included most or all of the following activities. 

1. Two or more familiar books from previous lessons were selected by the pupil to be read to the 
teacher. 

2. The teacher took a running record while the pupil read the book that was introduced to the pupil 
and attempted on the previous day. During this time the Reading Recovery teacher changed the 
focus from instruction to observation. Meaning, structure, and visual cues were analyzed to 
determine which cues were used or neglected by the pupil. Each day the teacher carefully 
recorded the pupil's development of reading strategies (e.g., self-monitoring, searching for cues, 
cross-checking, self-correcting) or ability to determine the meaning of continuous text. 

3. During letter identification, plastic letters were used on a magnetic board. 

4. The pupil dictated a story and then learned to write and read it with the teacher's help. 

5. During sound analysis of words from a written story, the pupil was encouraged to say the words 
slowly and write what could be heard. 

6. A completed story was cut into separate words, which were scrambled, and then rearranged in 
the correct order by the pupil. 

7. A new book was introduced by the teacher. 

8. The new book was attempted by the pupil. 

When it was determined by the Reading Recovery teacher, in consultation with the classroom teacher 
and the teacher leader, that a pupil had made sufficient progress to work successfully in the normal 
classroom setting without extra help, the pupil was recommended to be discontinued. Discontinued pupils 
were defined as those who had successfully completed the program according to predetermined levels on 
the observational tasks and had been released from the program. When pupils left the program (e.g., were 
discontinued, moved from the school, were placed in special programs), pupils entered the program either 
from the Early Literacy program or from a waiting list. 

Evaluation Design 

For program year 1992-93, two desired outcomes were established for the Reading Recovery 
program. Data collected in three major areas were incorporated in the analyses of the desired outcomes: 
pupil census information, pupil retainee information, and pupil independent reading achievement. Although 
not part of the evaluation design, parent involvement information was also collected by program teachers. 

Desired Outcome 1 : 

At least 75 percent of pupils who received 60 or more lessons or were discontinued will 
demonstrate satisfactory progress in the regular classroom as demonstrated by promotion to 
grade 2. 
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Desired Outcome 2: 

At least 50 percent of pupils who receive 60 or more lessons or were discontinued will read at 
least five books at text reading level 8 or above as certified by the program teacher. 

In addition to the desired outcomes, evaluation questions were developed based on two goals 
identified from the 1 984-85 proposal. The goals were: 

1 . To develop and provide the Reading Recovery program for first-grade pupils. 

The individual child who has been identified as being "at risk" of failure has recovered essential 
reading strategies and can function satisfactorily in the regular classroom. 

2. To adapt and apply the necessary inservice program for teachers. 

To implement the Reading Recovery techniques, teachers will receive intensive training over the 
period of a year while simultaneously implementing the program with children through clinical and 
peer-critiquing experiences guided by a skilled instructor. 

Based on these two goals, three evaluation questions regarding the 1992-93 Reading Recovery 
program were developed. The questions focused on the following areas: service patterns, posttest 
performance on a standardized test of reading, and long-term effects of the program. The specific 
evaluation questions and analyses for each are listed below. 

Question 1 What were the service patterns of pupils in the Reading Recovery program? 
Analysis 1 . 1 Number of pupils who were served. 
Analysis 1 .2 Number of pupils who were discontinued. 
Analysis 1 .3 Demographic characteristics of pupils who were served. 
Analysis 1 .4 Demographic characteristics of pupils who were discontinued. 

Question 2 What were the performance levels of Reading Recovery pupils on a standardized test 
of reading? 

Analysis 2.1 Number and percent of pupils reaching the 50%ile in Total Reading on the MAT6. 

Analysis 2.2 Number and percent of pupils reaching the 37%ile in Total Reading on the MAT6. 

Analysis 2.3 Number and percent of pupils reaching the average NCE for the district in Total 
Reading on theMAT6. 

Analysis 2.4 Analysis of central tendency and distribution of NCE scores of Total Reading on 
the MAT6. 

Question 3 What were the long-term effects of the Reading Recovery program? 

Analysis 3.1 Number and percent of pupils in the 1990-91 and 1991-92 Reading Recovery 
treatment groups who in 1992-93 attended a school where a compensatory 
program was available and who were served by a compensatory program. 

Analysis 3.2 Number and percent of pupils in the 1990-91, 1991-92, and 1992-93 Reading 
Recovery treatment groups who followed a normal grade level progression. 
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Instruments 

The evaluation design provided for the collection of data in the followinj five areas of operation for the 
overall program. Included in the collection of data was parent involvement information, which was not part 
of the evaluation design. 

1 . Teacher Census Information 

Teacher Census Form ( TCF) was completed by program teachers to obtain staffing information, 
including employment status, periods of program instruction, and school assignment (see 
Appendix C, p. 29). 

2. Pupil Census Information 

Calendar Worksheet/Parent Involvement Log (CW/PIL) was used to record pupil service 
information, Selection Scores, and parent involvement data (see Appendix D, pp. 31-32). 

Pupil Roster w as completed by program teachers to indicate official enrollment of each pupil into 
the program. Program teachers identified pupils served from computer generated lists of all first 
grade pupils in their buildings. Information included pupil name, student number, date of birth, 
program teacher name, school code, and program code. 

Pupil Data Sheet (PDS) was a computer generated preprinted form used by program teachers to 
summarize enrollment/attendance data, number of lessons, independent reading achievement 
information, parent involvement, discontinued status, hours of instruction per week, English- 
speaking status, and progress made for each pupil served (see Appendix E, p. 34). 

3. Retention Information 

District computer files were utilized to access retention data. 

4. Pupil Independent Reading Achievement/Pupil Standardized Achievement Test Information 

Pupil Data Sheet (PDS). described earlier, was a computer generated preprinted form used by 
program teachers to summarize independent reading achievement information for each pupil 
served (see Appendix E, p. 34). 

Ihfl Mfltmntf^ Achievement Teat* (MAT6, 1985) was used to obtain standardized 
achievement test information for all pupils in the Reading Recovery program. Results from the 
test were used as pretest scores for pupils in grade 2. This test series has empirical norms for 
spring, established April 8 to May 1 5, 1 985. The description of the MAT6 is as follows: 



Recommended Number 
Level Form Grade Range SlibtfiSt& of Items 

Primer L K.5-1.9 Vocabulary 15 

Word Recognition Skills 36 

Reading Comprehension 3fi 

Total Reading 89 

The MAT6 tests were administered by classroom and program teachers. Testing occurred March 
29-April 1 , 1993. All testing was done on level, as Indicated in the table above. 
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5. Parent Involvement Information 

Parent Im/oh/ament Log (PIL) was used to record parent involvement data, including the date, 
type of activity/involvement, and name of attendee(s) (see Appendix D, p. 32). 

Pupa Data si*** (PDS), described earlier, was a computer generated preprinted form used by 
program teachers to summarize data collected from the Parent Involvement Logs for each pupil 
served (see Appendix E, p. 34). 

Inservice evaluation information, data which were not specified in the Reading Recovery evaluation 
design but were collected routinely, is not included here but has been submitted to the Department of 
Federal and State Programs, Columbus Public Schools. 

Major Findings 

Pupils Served/Desired Outcomes 

During the 1992*93 school year, a total of 305 pupils were served by the Reading Recovery program. 
The treatment group for 1992-93 was limited to the 82 pupils who were discontinued and the 80 additional 
pupils who had a minimum of 60 lessons but were not discontinued (a total of 162 pupils or 53.1% of all 
pupils served). The use of the 60 lesson distinction was based upon the premise in Marie Clay's research 
in New Zealand (1979) which determined that an average of 60 lessons was needed for pupils to be 
discontinued and to continue to work successfully in the normal classroom setting. Thus, the 143 other 
pupils served were excluded from the treatment group. The evaluation sample used for evaluation of 
standardized achievement test performance was restricted to those pupils who were in the treatment group, 
were English-speaking, had spring administration of the standardized achievement test (MAT6), and had a 
valid MAT6 Total Reading score. Of the 1 62 pupils in the treatment group, 6 pupils were excluded from the 
evaluation sample because of incomplete test data. The evaluation sample was comprised of the 
remaining 1 56 pupils, which was 96.3% of the treatment group and 51 .1% of the 305 pupils served. 

Desired Outcome 1: 

At least 75 percent of pupils who received 60 or more lessons or were discontinued will demonstrate 
satisfactory progress in the regular classroom as demonstrated by promotion to grade 2. 

Desired Outcome 1 was based on the number of pupils who were discontinued from the Reading 
Recovery program or who had received 60 or more lessons during the school year. A total of 162 pupils 
met one of these criteria. Of these 162 pupils, retention data were available for 160 pupils. Of these 160 
pupils, 1 47 (91 .9%) were not retained. Thus, Desired Outcome 1 was met. 

Desired Outcome 2: 

At least 50 percent of pupils who receive 60 or more lessons or were discontinued will read at least 
five books at text reading level 8 or above as certified by the program teacher. 

Desired Outcome 2 was also based on the number of pupils who were discontinued from the Reading 
Recovery program or who had received 60 or more lessons during the school year. Of the 162 pupils who 
met one of these criteria, 149 (92.0%) read five books at text reading level 8 or above, thus allowing 
Desired Outcome 2 to be met. 

Parent Involvement 

Records of parent contacts and activities were maintained by program teachers using the Parent 
Involvement Log (Appendix D., p. 32) to document the date of parent contact, the type of activity, and which 
parents or guardians participated in each activity. Table 2 displays parent involvement data 
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Table 2 

Number of Parents 
Reported for Parent Involvement Activities for 
Reading Recovery Program 
1992-93 



Totals for Year 



Treatment All Pupils 

Program Activities Group Pupils 9 Served 
(N-162) (N«305) 

1 . Parents involved in the planning, operation 
and/or evaluation of your unit 

Number of Parents 10 13 

Number of Contacts 14 19 

2. Group meetings for parents 

Number of Parents 48 57 

Number of Contacts 57 68 

3 . Individual parent conferences 

Number of Parents 208 335 

Number erf Contacts 520 775 

4. Parental classroom visits or field trips 

Number of Parents 77 1 1 2 

Number of Contacts 1 26 1 79 

5. Visits by teacher to parents' homes 

Number of Parents 20 32 

Number of Contacts 25 39 



Total Parents Contacted 1 * 221 355 

Total Number of Contacts 742 1 ggg 



a Treatment Group Pupils are those who were discontinued from the program or had 60 or more 
lessons. 

b Total Parents Contacted is based on an unduplicated count of parents contacted, which is less 
than the sum obtained when combining the Number of Parents for Activities 1-5. 
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collected by program teachers on the Parent Involvement Log for each of the 305 pupils served ki the 
program. The data indicate that a total of 355 different parents or guardians were involved in some way 
with the program and that program teachers made 1080 contacts with these 355 individuals. It should be 
noted that the tota 5 number of parents involved is not additive, as a parent could be involved in more than 
one activity for the year. The majority of contacts (71 .8%) with parents or guardians was through individual 
parent conferences (775 contacts). The smallest number of contacts with parents or guardians involved 
planning, operating, and/or evaluating the program, with 19 contacts (1 .8% of al contacts made). Table 2 
also displays parent involvement data for the parents of the 1 62 treatment group pupils. The 162 treatment 
group pupils represented 53.1% of the 305 pupils served, but represented 68.7% (742) of the total number 
of contacts made for the year and 62.3% (221 ) of the individual parents involved in the program. Sfcntarto 
parent involvement for all pupis served, the majority (70.1%) of the parent contacts for treatment group 
pupils was with individual conferences (520 contacts). The smallest number of contacts with parents or 
guardians of treatment group pupils also involved planning, operating, and/or evaluating the program, with 
1 4 contacts (1 .9% of all contacts made). 

Program teachers also maintained records, using the Parent Involvement Log, if parents helped their 
child with homework and if the parents read to their child or the child read to the parents. Of the 305 pupils 
served, 89.5% (273) had parents who helped with homework and 93.1% (284) either read to their parents 
or had their parents read to them. For the 1 62 treatment group pupils, 93.2% (151) had parents who helped 
with homework and 96.3% (1 56) either read to their parents or had 'their parents read to them. 

Evaluation Questions 

Question 1 What were the service patterns of pupils in the Reading Recovery program? 
Analysis 1.1 Number of pupils who were served. 
Analysis 1 .2 Number of pupils who were discontinued. 
Analysis 1 .3 Demographic characteristics of pupils who were served. 
Analysis 1 .4 Demographic characteristics of pupils who were discontinued. 

The service patterns of the Reading Recovery program are reported below in the following order the 
number of pupils who were served and their demographic characteristics; the number of lessons received; 
and the number of pupils who were discontinued and their demographic characteristics. 

The 1992-93 Reading Recovery program served a total of 305 first-grade pupils in 60 schools (see 
Table 1, page 2). During 1991-92, 227 pupils were served in 41 schools, an increase in pupils served of 
approximately 34.4% (78 pupils) for school year 1992-93. This increase in pupils served resulted in part 
from an increase in program teachers from 13.0 FTEs to 16.5 FTEs, a 26.9% increase in teaching staff. 
Reading Recovery pupils received 30-minute lessons daily, for an average of 2.5 hours of instruction per 
week. 

The demographic characteristics (gender, race, and socio-economic status) of the 305 pupils who 
were served in the program were analyzed from the school district's Student Master File (SMF), Pupil 
information File (PIF), and November 1992 official enrollment tape. The data were based on information 
reported by parents and/or school personnel. Of the pupils served, 59.0% (180) were boys and 41.0% 
(125) were girts (see Table 3). As for the distribution by race, 37.0% (1 13) of the pupils served were 
identified as Non-Minority, 62.3% (190) were Black, and the remaining 0.7% (2) were Other Minority (see 
Table 4). The Other Minority category included Spanish Surname, Asian American, and American Indian. 
Socio-economic status was indicated by pupil eBgfoility for subsidized (free or reduced price) lunch as of 
June 1993. Of the 305 pupils served, 83.3% (254) were on free lunch, 4.3% (13) were on reduced price 
lunch, and 1 2.5% (38) were not on subsidized lunch (see Table 5). 
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For evaluation purposes* the pupils served in the program were divided into three categories: 
discontinued pupils (those who had successfully completed the program); not discontinued pupils who had 
received 60 or more lessons; and other pupils served (those who were not discontinued and who received 
fewer than 60 lessons). Of the 305 pupils served during 1992-93, 26.9% (82) were discontinued, 26.2% 
(80) were not discontinued but received 60 or more lessons, and 46.9% (143) were other pupils served 
(see Table 6). For 1991-92, program data revealed that 34.4% of pupils were discontinued, 17.2% were 
not discontinued but received 60 or more lessons, and 48.6% were other pupils served. The data show 
that the percent of pupils discontinued decreased and that the percent of pupils who received 60 or more 
lessons but were not discontinued Increased. When looking at only treatment group pupils (those who 
were discontinued or had 60 lessons or more), data show that 50.6% (82 out of 162 pupils) were 
discontinued during 1992-93. During 1991-92, there were 117 treatment group pupils, with 78 (66.7%) 
being discontinued, a decrease of over 10 percent from the 1991 -92 to 1992-93 school year. 

Enrollment data indicate that for 1992-93, average pupil enrollment was 76.7 days, compared to 
average pupil enrollment of 71.1 days in 1991-92. The average pupil attendance was 66.7 days in 1992- 
90, compared to 62.0 days for 1991-92. The number of lessons completed by pupils ranged from none to 
1 22, with an average of 55.2 lessons, compared to an average of 51 .1 lessons in 1 991-92. It was possible 
for a pupil to be enrolled in the program and receive no lessons. During the first 10 days of program 
attendance, pupils are "Roaming Around the Known." These 10 days count as days of enrollment and 
attendance, but not as days of lessons. During 1992-93, 10 pupils were enrolled and attended the 
program, but withdrew before they could begin lessons, and therefore had no lessons recorded. During 
1992-93, the average number of pupils served by each teacher (16.5 FTEs) was 18.5 pupils and the 
average number of pupils discontinued by each teacher was 5.0 pupils, compared with 17.5 pupils served 
and 6.0 pupils discontinued by each teacher in 1 991-92. 

A continuing concern of program planners is how long to serve pupils who appear to make little or no 
progress after a large number of lessons. Approximately 60 lessons are considered necessary for most 
pupils to successfully complete the program. However, in 1992-93, the number of lessons needed by 
pupils to be discontinued varied greatly. For example, four pupils were discontinued with less than 40 
lessons but 28 other pupils were not discontinued after 100 or more lessons. The number of lessons 
completed by pupils who were discontinued ranged from 13 to 1 18, with an average of 71 .5 lessons. The 
number of lessons completed by pupils who were not discontinued (the two other pupil categories 
combined) ranged from none to 122 lessons, with an average of 49.1 lessons. Of the 139 pupils who 
received 60 or more lessons, 42.4% (59) were discontinued and 57.6% (80) were not discontinued. A 
distribution of the number of lessons completed by pupils in the three pupil categories is shown in Table 6. 

An examination of the 82 pupils who were discontinued from the program revealed that 45 (54.9%) 
were boys and 37 (45.1%) were girls. These figures are representative of all pupils served (see Tables 3 
and 7). Of the 180 boys served, 25.0% were discontinued, comparable to the 29.6% discontinued for the 
125 girls served. The analysis by race indicated that 59.8% (49) of the discontinued pupils were Black, 
which was comparable to the percent of all pupils served who were Black (62.3%). Non-minorities made 
up 40.2% (33) of discontinued pupils and no Other Minority pupils were discontinued (see Tables 4 and 8). 
Of the 82 discontinued pupils, 74.4% (61) were on free lunch, 3.7% (3) were on reduced lunch, and 22.0% 
(18) were not on subsidized lunch. When comparing these figures to ail pupils served, smaller percentages 
of discontinued pupils were on free or reduced priced lunch and a higher percentage of discontinued pupils 
was not on subsidized lunch (see Tables 5 and 9). 

Question 2 What were the performance levels of Reading Recovery pupils on a standardized test 
of reading? 

Analysis 2.1 Number and percent of pupils reaching the 50%ile in Total Reading on the MAT6. 
Analysis 2.2 Number and percent of pupils reaching the 37%lle in Total Reading on the MAT6. 
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Table 6 

Percent and Number of Reading Recovery Pupils 
Served by Pupil Category and Number of Lessons 
1992-93 



Pupil Category 

Not Other Total 

Number of Discontinued Discontinued Pupils Pupils 

Lessons Pupils* Pupils 6 Served 0 Served 





% 




% 


(N) 


% 




% 


(N) 


Fewer than 60 


















0-9 


0.0 


(0) 






21.7 


(31) 


10.2 


(31) 


10-19. 


3.7 


(3) 






20.3 


(29) 


10.5 


(32) 


20-29 


3.7 


(3) 






14.7 


(21) 


7.9 


(24) 


30-39 


4.9 


(4) 






11.2 


(16) 


6.6 


(20) 


40-49 


7.3 


(6) 






19.6 


(28) 


11.1 


(34) 


50-59 


8.5 


(7) 






12.6 


(18) 


8.2 


(25) 


Subtotal 


28.0 


(23) 






100.0 


(143) 


54.5 


(166) 


60 or More 


















60-69 


12.2 


(10) 


15.0 


(12) 






7.2 


(22) 


70-79 


19.5 


(16) 


23.8 


(19) 






11.5 


(35) 


80-89 


15.9 


(13) 


6.3 


(5) 






5.9 


(18) 


90-99 


12.2 


(10) 


20.0 


(16) 






8.5 


(26) 


100-109 


7.3 


(6) 


17.5 


(14) 






6.6 


(20) 


110-119 


4.9 


(4) 


16.3 


(13) 






5.6 


(17) 


120-129 


0.0 


(0) 


1.3 


(1) 






0.3 


0) 


130-139 


0.0 


(0) 


0.0 


(0) 






0.0 


(0) 


Subtotal 


72.0 


(59) 


100.0 


(80) 






45.6 


(139) 


Total 


100.0 


(82) 


100.0 


(80) 


100.0 


(143) 


100.0 


(305) 



a Discontinued pupils could have any number of lessons 
b Not discontinued pupils with 60 or more lessons 
c Other pupils served with fewer than 60 lessons 
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Analysis 2.3 Number and percent of pupils reaching the average NCE for the district in Total 
Reading on the MAT6. 

Analysis 2.4 Analysis of central tendency and distribution of NCE scores of Total Reading on 
theMAT6. 

MAT6 test scores from spring 1993 were analyzed for the 156 pupils in the evaluation sample and for 
certain suogroups within the evaluation sample (see Tables 10 and 11). Table 10 presents data showing 
the number and percent of pupils reaching the 37%ile and 50%ile in Total Reading on the MAT6 spring 
testing. Of the 156 pupils in the evaluation sample, 23.1% (36) reached the 37%ile on the test, with 17.9% 
(28) reaching the 50%ile on the test. The remaining 120 pupils (76.9%) in the evaluation sample had test 
scores below the 37%ile, indicating that they were still eligible for Chapter 1 program sen/ice. Those pupils 
who were successfully discontinued from the program reached the 37%ile and 50%ile on the test at much 
higher percentages than did those pupils who were not discontinued and received 60 or more lessons. Of 
the 80 discontinued pupils, 41.3% (33) reached the 37%ile and 33.8% (27) reached the 50%ile, but only 
3.9% (3) of the 76 not discontinued pupils who received 60 or more lessons reached the 37%ile. One 
( 1 .3%) of these 76 pupils reached the 50%ile on the test. 

When comparing the percents of pupils reaching the 37%ile and 50%ile in Total Reading on spring 
testing over the seven year period from 1987 to 1993, the data reported in Table 11 show that from the 
1 991-92 to 1992-93 school year there was a decrease in the percent of pupils reaching the 37%ile (51.4% 
to 23.1%) and a decrease in the percent of pupils reaching the 50%ile (35.1% to 17.9%). The data also 
indicate that when the test was changed from the CTBS, 1981, to the MAT6, 1985, beginning with the 
1988-89 school year, test scores dropped. The decrease, in part, resulted from the MAT6, 1985, being 
considered to be a more difficult test than the CTBS, 1981. Research indicates that tests normed in 1985 
would be more difficult than those normed In 1981 because reading scores nationwide rose over the period 
from 1981-1985. Another possible explanation for the dramatic decrease in 1988-89 may be attributed to 
the inappropriateness of the pretest level of the MAT6, 1985, administered at that time. Tha MAT6 results 
may not have reflected true pupil performance during 1988-89. The pretest level was found to be too 
difficult for low-achieving pupils, while the posttest level was found to be too easy for the average and 
above-average pupils. More appropriate pretest and posttest levels were administered in 1989-90 and 
thereafter. The increases in the percents of pupils reaching the 37%ile and 50%ile in Total Reading during 
1 990-91 and 1 991-92 can, in part, be attributed to the selection process for pupils into the program. Prior to 
1990-91, pupils scoring the lowest on the selection test were served by the Reading Recovery program. 
But in 1990-91 , with the establishment of the Early Literacy program, the lowest pupils were served in Early 
Literacy and not Reading Recovery. Also, many pupils entered the Reading Recovery program after 
having been served in the Early Literacy program, resulting in pupils entering the Reading Recovery 
program with higher reading skills and strategies. But again in 1992-93, the lowest pupils were served in 
Reading Recovery and not Early Literacy. This, in part, may attribute to the decrease in the percents of 
pupils reaching the 37%ile and 50%ile in Total Reading from the 1991-92 school year to the 1992-93 
school year. 

The data derived from Analysis 2.3, relating to the number and percent of pupils reaching the average 
NCE for the district in Total Reading on the MAT6, show that of the 156 pupils in the evaluation sample, 34 
(21.8%) reached the average NCE (45.6 NCEs) for the district In Total Reading. Of the 80 pupils in the 
evaluation sample who were successfully discontinued, 32 (40.0%) reached the district average, while only 
two (2.6%) of the evaluation sample pupils who were not discontinued and received 60 or more lessons 
(76) reached the district average NCE for the posttest. 

For analysis 2.4 the Shapiro-Wilk W Test was run to determine whether or not the distribution of the 
Total Reading scores were relatively normal. Results indicated the distribution of 156 scores did differ 
significantly from a normal distribution, suggesting that the scores were not normally distributed at 
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Table 10 

Percent and Number of Evaluation Sample Pupils 
Reaching 37%ile and 50%ile on MAT6 
Total Reading by Pupil Category 
1992-93 



Total Reading 





Pupil 






37%ile 




50%ile 








Category 




N_ 


% 




w 


% 




(N) 




Discontinued 




80 


41.3 




33 


33 8 




27 




Not Discontinued and 
60 or More Lessons 


76 


3.9 




3 


1.3 




1 




Total Sample 




156 


23.1 




36 


17.9 




28 








Table 1 1 

Percent and Number of Evaluation Sample Pupils 
Reaching 37%ile and 50%ile on MAT6 
Total Reading by Year 
1987-93 






















Total Reading 






School 










37%ile 




50%ile 




Year 




N. 


Test 




% 


<N) 




% 




(N) 


1986-87 




189 


CTBS, 1981 




38.6 


73 




18.5 




35 


1987-88 




253 


CTBS, 1981 




33.2 


84 




15.0 




38 


1988-89 




104 


MAT6, 1985 




22.1 


23 




11.5 




12 


1989-90 




184 


MAT6, 1985 




22.8 


42 




15.2 




28 


1990-91 




139 


MAT6, 1985 




37.4 


52 




23.7 




33 


1991-92 




111 


MAT6. 1985 




51.4 


57 




35.1 




39 


1992-93 




156 


MAT6, 1985 




23.1 


36 




17.9 




28 



20 




2.2 PM 10:04 AM 
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posttesting. Further examination of the data revealed that the distribution was slightly different from a 
normal distribution; however, the mean was not substantially higher than the median and no significant 
number of students scored below the guess level. Thus, the Shapivo-Wik W Test, a very powerful test 
(Shapiro, Wilk, and Chen, 1968) when testing for departures from normality, indicates there were 
departures from normality, however, the additional analyses reveal that these departures are not great 
enough for concern. 

Questi n3 What were the long-term effects of the Reading Recovery program? 

Analysis 3.1 Number and percent of pupils in the 1990-91 and 1991-92 Reading Recovery 
treatment groups who in 1992-93 attended a school where a compensatory 
program was available and who were served by a compensatory program. 

Analysis 3.2 Number and percent of pupils in the 1990-91, 1991-92, and 1992-93 Reading 
Recovery treatment groups who followed a normal grade level progression. 

Analysis 3.1 and 3.2 were conducted from available follow-up data for pupils who were in the 1990-91 , 
1991-92, and 1992-93 treatment groups. The original 1990-91 treatment group was comprised of 154 
pupils, the 1991-92 treatment group was comprised of 1 17 pupils, and the 1992-93 treatment group was 
comprised of 162 pupils. The number of pupils included in the analyses for Question 3 varied due, in part, 
to pupil mobility, the timing of data collection, and different restrictions inherent in the various analyses. 

Table 12 contains a summary of results for Analysis 3.1 , the study of the 1990-91 and 1991-92 
Reading Recovery treatment group pupils who were served by a compensatory program in 1992-93. The 
analysis included three compensatory programs: the Chapter 1 Reading program, the Early Literacy 
program, and the Reading Recovery program. Pupils who were on a waiting list to be served by a 
compensatory education program were not included in Analysis 3.1 . The criterion scores used to establish 
eligibility for program service varied from program to program. Availability of service depended on the 
number of pupils qualifying for service at a particular building and the number of compensatory education 
teachers assigned to that building. 

Of the 154 pupils in the 1990-91 Reading Recovery treatment group, 132 pupils were in a school and 
at a grade level where a compensatory program was in operation during the 1992-93 school year (see 
Table 12). Of these 132 pupils, 36.4% (48) were served in a compensatory program. By grade level, 
80.0% (12) of the 15 pupils in grade 2 were served, compared to 30.8% (36) of the 1 17 pupils in grade 3. 
For the 1990-91 treatment group, the percent of discontinued and not discontinued pupils served by a 
compensatory program varied. In grade 2, 50.0% (3) of the 6 discontinued pupils were served In a 
compensatory program compared to 100.0% (9) of the 9 not discontinued pupils. In grade 3, 26.5% (26) of 
the 98 discontinued pupils were served in a compensatory program compared to 52.6% (10) of the 19 not 
discontinued pupils. Overall, 27.9% (29) of the 104 discontinued pupils in grades 2 and 3 were served in a 
compensatory program in 1991-92, two years after they completed the Reading Recovery program. 

Of the 1 17 pupils in the 1991-92 Reading Recovery treatment group, 1 16 pupils were in a school and 
at a grade level where a compensatory program was in operation during the 1992-93 school year (see 
Table 12). Of these 1 16 pupils, 31.0% (36) were served in a compensatory education program. By grade 
level, one (50.0%) of the 2 pupils in grade 1 was served, compared to 30.7% (35) of the 1 14 pupils in grade 
2. In grade 2, 15.6% (12) of the 77 discontinued pupils were served compared to 62.2% (23) of the 37 not 
discontinued pupils. 

Table 13 summarizes results for Analysis 3.2, the distributions of pupils in the 1990-91, 1991-92, and 
1992 93 Reading Recovery treatment groups who followed a normal grade-level progression. Only pupils 
who were enrolled in the Columbus Public Schools during the month of November in all of their follow-up 
years (1991, 1992, and/or 1993) were included in the analysis. The numbers of pupils included from the 
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Table 13 

Percent and Number of Pupils in the 1990-91. 1991-92, and 1992-93 
Reading Recovery Treatment Groups by Grade-Level 
Progression Through November 1993 



Grade-Level Progression 

Not Normal Normal Total 

Treatment Group % (N) % (N) % (N) 



1990-91 



199 



Discontinued 


9.7 


(9) 


90.3 


(84) 


100.0 


(93) 


Not Discontinued 


43.8 


(10) 


56.5 


(13) 


100.0 


(23) 


Subtotal 


16.4 


(19) 


83.6 


(97) 


100.0 


(116) 


1-92 














Discontinued 


0.0 


(0) 


100.0 


(69) 


100.0 


(69) 


Not Discontinued 


11.4 


(4) 


88.6 


(31) 


100.0 


(35) 


Subtotal 


3.8 


(4) 


96.2 


(100) 


100.0 


(104) 


(2-93 














Discontinued 


1.3 


(D 


98.7 


(76) 


100.0 


(77) 


Not Discontinued 


15.5 


(11) 


84.5 


(60) 


100.0 


(71) 


Subtotal 


8.1 


(12) 


91.9 


(136) 


100.0 


(148) 



Total 



Discontinued 


4.2 


(10) 


95.8 


(229) 


100.0 


(239) 


Not Discontinued 


19.4 


(25) 


80.6 


(104) 


100.0 


(129) 


Subtotal 


9.5 


(35) 


90.5 


(333) 


100.0 


(368) 



Note, The 1 990-91 treatment group was followed for 3 years (normal progression into grade 4), 
the 1991-92 treatment group for 2 years (normal progression into grade 3), and the 1992* 
93 treatment group for 1 year (normal progression into grade 2). Only pupils enrolled in 
the Columbus Public Schools during November in each of their follow-up years were 
included in the analysis. 
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three treatment groups were: 1 16 pupils (75.3%) from the 1890-91 treatment group, 104 pupils (88.9%) 
from the 1991-92 treatment group, and 148 pupils (91.4%) from the 1992-93 treatment g.oup, for a 
combined totaS of 368 pupils (85.0%) from the three treatment groups. 

The percentages of pupils who followed a normal grade-level progression were as follows: 83.6% (97) 
of the 116 pupils from the 1990-91 treatment group followed a normal grade-level progression into the 
fourth grade; 96.2% (100) of the 104 pupils from the 1991-92 treatment group followed & normal 
progression into the third grade; and 91.9% (136) of the 148 pupils from the 1992-93 treatment group 
followed a normal grade-level progression Into the second grade in 1993-94. Overall, 90.5% (333) of the 
368 pupils in the analysis followed a normal grade-level progression and 9.5% (35) did not. 

In each of the three treatment groups a greater percentage of discontinued pupils than not 
discontinued pupils followed the normal progression. For discontinued pupils, the percentages who 
followed the normal progression ranged from 90.3% for the 1990-91 treatment group pupils to 100.0% for 
the 1991-92 treatment group pupils. For not discontinued pupils the percentages who followed a normal 
progression ranged from 56.5% for the 1990-91 treatment group pupils to 88.6% for the 1991-92 treatment 
group pupils. 

Over the three year period 1990-91, 1991-92, 1992-93, data Indicated that the percentage of treatment 
group pupils retained in grade 1 had decreased then increased. For 1990-91, data were available for 145 
pupils and showed 4.1% (6) of those served in 1990-91 had been retained In grade 1. In 1991-92, 1.8% (2) 
of the 1 13 treatment group pupils were retained in grade 1 . For 1992-93, 8.1% (13) of the 160 pupils with 
follow-up data were retained in grade 1, while 5.0% of the 418 pupils In the three groups combined had 
been retained in grade 1. 



Summary/RecnmfMndattnna 

In 1992-93 the Reading Recovery program was located in 60 elementary schools and had a staff of 66 
teachers (1 6.5 FTEs). For evaluation purposes, the program started on September 21 , 1 992 and continued 
through May 14, 1993. The program served a total of 305 underachieving first-grade pupils who appeared 
unlikely to read successfully without Intensive Instruction. These 305 pupils were enrolled in the program 
for an average of 76.7 days, attended the program an average of 66.7 days, and received an average of 
55.2 lessons. The number of lessons received ranged from none to 122. 

Records of parent contacts and activities maintained by program teacher for the 305 pupils served 
indicated 355 different parents or guardians were involved in some way with the program. These 355 
individuals made a total of 1080 contacts with program teachers. The 162 treatment group pupils 
represented 53.1% of the 305 pupils served, but represented 68.7% (742) of the total number of oontacts 
and 62.3% (221) of the individual parents involved in the program. 

Pupils were discontinued from the program based on scores on diagnostic measures indicating that 
they were reading at the level of their classroom and based on teacher judgment that the pupils had 
developed effective reading strategies. Of the 305 pupils served, 26.9% (82) were discontinued, 26.2% 
(80) received 60 or more lessons but were not discontinued, and 46.9% (143) were not discontinued and 
received less than 60 lessons. Of the 139 pupils who received 60 or more lessons, 42.4% (59) were 
discontinued. 

The treatment group consisted of the 162 pupils who were either discontinued (82) or received 60 or 
more lessons but not discontinued (80). The evaluation •ample consisted of the 156 pupils who wen 
discontinued or had 60 or more lessons, were English-speaking, and had received a valid Total Reading 
score on the MAT6 spring test. The two desired outcomes for the 1992-93 Reading Recovery program 
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were met. Of the 162 pupils in the treatment group, retention data was available for 160 pupils. Of these 
160 pupils, 147 (91.9%) were not retained (criterion was 75.0%). Of the 162 treatment group pupils, 149 
(92.0%) read five or more books at text reading level 8 or above (criterion was 50.0%). 

Thirty-four (21.8%) of the evaluation sample pupils reached the average NCE (45.6) for the district as 
a whoid. The percentages of pupils who were at various percentile levels on the spring test were as 
follows: (a) 17.9% (28) were at the 50%ile or above (grade level); and (b) 76.9% (120) were below the 

37%ile and still eligible for Chapter 1 services. 

Analyses of the long-term effects of Reading Recovery produced the following results. Of the former 
Reading Recovery pupils who were in a school and at a grade level where a compensatory education 
program was in operation in 1992-93, 36.4% (48) of the pupils from the 1990-91 treatment group and 31 .0% 
(36) of the pupils from the 1 991-92 treatment group were served in a compensatory program. 

Of the 368 pupils from the combined 1990-91, 1991-92, and 1992-93 treatment groups who remained 
in Columbus Public Schools through November 1993, 90.5% (333) followed a normal grade-level 
progression. The retention rates for grade 1 were: 4.1% for the 1990-91 treatment group, 1.8% for the 
1991-92 treatment group, 8.1% for the 1992-93 treatment group, and 5.0% for the three treatment groups 

combined. 

The Reading Recovery program has been continued during the 1993-94 school year, and it is 
recommended that it continue. With that in mind, the following recommendations are presented: 

1 . The process by which pupils are discontinued from the program needs to be re-examined. Pupils 
are to be discontinued from the program when they reach the average reading ability of their 
classroom. Often times program teachers keep pupils in the program too long after they have 
reached the average level of ability for their classroom. If pupils are kept too long in the program, 
other pupils may be denied service. 

2. Efforts should continue for exploring ways to minimize the amount of time needed to colled data on 
pupils served. Much teacher frustration exists because of the volume of record keeping required 
for the program. Teachers maintain records for both Columbus Public Schools and The Ohio State 
University College of Education. If both institutions used the same set of data, reporting by both 
institutions would be consistent and the amount of paperwork required of teachers reduced. 

3. As increased parent involvement is regarded as one of the indicators of effective schools, every 
effort must be undertaken to promote parental involvement in the program, especially in the areas 
of planning, operation, and evaluation. 

4. The earliest possible identification of pupils needing special education instruction should be 
emphasized. Pupils with special needs can be better served by teachers with expertise in specific 
special education areas. Reading Recovery is not a special education program. If pupils with 
special education are not identified early, they remain in the Reading Recovery program too long, 
creating frustration for both pupils and teachers. 

5. The whole language instructional strategies and techniques used by program teachers need to be 
shared with and enhanced by the regular classroom teacher. The instruction provided by the 
program teacher and by the regular classroom teacher must complement each other. The 
academic achievement of pupils will suffer if they receive mixed messages in their reading and 
writing instruction. Opportunities must be made available for program teachers and regular 
classroom teachers to develop a consistent whole language based approach to instruction. 
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6. Inservice meetings should be continued to provide program teachers the opportunity to enhance 
their instructional intervention skills, to share instructional ideas with one another, and to clarify any 
concerns or misconceptions they may have about the total Reading Recovery program. 

7. An on-going process of site visitations by the program evaluator needs to be continued. Those 
visits provide invaluable information for the program evaluator in the areas of content and 
instruction and provide program teachers the opportunity to clarify questions they may have about 
evaluation requirements and record keeping, These visitations also help build a rapport between 
the program teacher and program evaluator. 
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Concepts About Print and Dictation 



31 

O v. I'mhmu'Fcriwj 

ERjC *-2i-94 9:46 AM 



CONCEPTS ABOUT PRINT SCORING SHEET 



Date: 



Stones: 



School Name: 



Classroom Teacher: 



Sand: 



TEST SCORE 




Use the script when administering this tttt 



PAGE 



Cover 



2/3 



4/5 



8/9 



10/11 



12/13 



SCORE 



14/15 



16/17 



18/19 
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ITEM 



1 . Front of book 



2. Print contains message 



3. Where to start 

4. Which way to go 

5. Return sweep to left 

6. Word by word matching 



7. First and last concept 



8. Bottom of picture 



9. Begin The' (Sand) or T (Stones) 
bottom line, top OR turn book 



10. Line order altered 



1 1 . Left page before right 

12. One change in word order 

13. One change in letter order 



14. One change in letter order 

15. Meaning of? 



16. Meaning of period/full stop 

17. Meaning of comma 

18. Meaning of quotation marks 

19. Locate MmHh (Sand) OR 
Tt Bb (Stones) 



20. Reversible words (was, no) 



21. One letter: two letters 

22. One word: two words 

23. First & last letter of word 

24. Capital letter 



Directions 

1 . Place the. pupil's ID label on the back of the form. 
If there is no ID label for a pupil, please provide 
student number, birthdate, student's legal name 
(last, first, Ml), grade, and school code in the 
space provided. 

2. Put an X in the blank next to the form of the test 
the student took (either Stones or Sand). 

3. In the score column, place a 1 (one) beside each 
correct item. K the item was incorrect, place a 0 
(zero) in the column. 

4. Record the total number of items correct in the 
test score box. 

5. Turn this form over and enter data from the 
Dictation test. 
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Date: 



TEST SCORE 



School Name: 



Classroom Teacher: 




The bus is co 
12 345 67 89 



m 
1 
0 



i n g. 
1 1 1 
1 2 3 



I t 
1 1 
4 5 



will 
1 1 1 
6 7 8 



stop 
12 2 2 
9 0 12 



here 

2 2 2 

3 4 5 



to let me get on. 
22 223 33 333 33 
67 890 12 345 67 



Directions 

1 . Be certain you have completed the required information at the bottom of the form or placed an ID label on the form. 

2. Follow the directions for administering and scoring the Dictation test. 

3. In the blank above each phoneme, place a 1 (one) if the pupil responded correctly. If the phoneme was incorrect, 
place a 0 (zero) in the blank. If the phoneme was not attempted, do not mark anything on the line. 

4 . Record the total number of correct phonemes in the test score box. 

5. Return this form to your program evaluator at the Department of Program Evaluation, 52 Starling Street. Keep a copy 
in your files. 





PLACE LABEL HERE 




STUDENT NO. 


DIRTHDATB 






M 


M D D Y Y 


NAME 








LAST FIRST 


MI 


GRADE 


SCHOOL CODE 
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Selection Score Matrix 
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Teacher Census Form 





l>: P501NHPFCKR9J 
2. 2544 9:46 AM 




Teacher Census Form 

1992-93 



Social Security Number 



Name 



(Legal Name for Mailing Labels) 
School Assignment 



Your Program Coordinator/Teacher Leader. 



Cost Center 



List all Chapter 1/DPPF programs you are involved with: 
Program 

1. 

2. 

3. 

4. 



Program Code 



Full-Time Employee 

or (check one) 
Part-Time Employee 



Number of Reading Recovery sections per day 
Number of Early Literacy -Gr. 1 groups per day 
Number of Early Literacy -Gr. 2 groups per day 
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Appendix D 
Calendar Wo rksheet/Parent Involvement Log 
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ESEA • Chapter 1 
Parent Involvement Log 

1992*93 



Program Code 



Name of Pupil 



Grade 



9 

ERIC 



Parent Name Address Phone Number 

THE COLLECTION OF PARENT INVOLVEMENT DATA 18 REQUIRED BY CHAPTER 1. 

Please check H the following two activities occurred tor this pupil anytime this year. 



B 



Parent helped child with homework 
Parent read to child or child read to parent 



DIRECTIONS: Please indicate in the fields below the date, activity, name of parent/guardian, and thrHme- 
(H o urs) yo u s pent with t he p a rsnt (s). nOU N D MOUnO TO TlIC NEAREST TENTH 
Obviously, you may keep expanded notes about activities somewhere else. 



Date 

MMDDYY 



Activity* 
(1-5) 



Attendees) 

Parent/Guardian 



1 1 — 

I imJi j 

AAA 



'Hindi of Parent Involvement to reoord tor the column labeled Atihtlfy. 

(1 ) Involved in planning (do not include advisory council) 

(2) Group meetings (do not include advisory council) 

(3) Individual conferences (telephone conferences included) 

(4) Parental olassroomvlsNs 
(8) Home visits 
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* Pupil Data Sheet 
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SHEET 

12 SCHOOL CODE 
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Zo 1 umous Pud 1 i c Scnoo I a 

Compensatory E ducat ion Programs 

PUPIL DATA SHEET 

PROGRAM CODE 9 3 3 0 4 SSN 



April 8, 1993 
14 37 



SCHOOL NAME 
1 . STUDENT NAME 



2. STUDENT NO. 



PROGRAM NAME 



TEACHER NAME 



1 ast 

GRADE 



f 1 rst 



BIRTHDATE 



3. AVERAGE HOURS PER WEEK OF INSTRUCTION 



4 . 


PUPIL PROGRESS 


NONE 


SOME 


5 . 


IS THIS PUPIL ENGLISH SPEAKING? 


NO 


YES 


6 . 


WAS THIS PUPIL DISCONTINUED? 
( CAREFULLY READ GUIDELINES) 


NO 


YES 


7 . 


PARENT HELPED WITH HOMEWORK? 


NO 


YES 


8 . 


PARENT PEADS TO CHILD OR CHILD READS 
TO PARENT? * 


NO 


YES 



MUCH 



FOR NUMBERS 9-13. FILL IN THE NUMBER OF THIS PUPIL'S PARENTS INVOLVED 
IN EACH ACTIVITY DURING THE YEAR AND TOTAL NUMBER OF CONTACTS. 



NO. OF PARENTS 



TOTAL NO 



10. 



PLANNING 



GROUP MEETINGS 



11. INDIVIDUAL CONFERENCES 



12 . 



13 . 



HOME VISITS 



CLASSROOM VISITS | 



I 



OF CONTACTS 



THRU 05-14-93 



14. NUMBER OF DAYS SERVICE SCHEDULED 
(CAREFULLY READ INSTRUCTIONS) 



15. NUMBER OF DAYS SERVICE RECEIVED 
(CAREFULLY READ INSTRUCTIONS) 



16. WHILE IN YOUR CLASS. tne Numoer of Books Read at 
Text Reading Laval Greater than 7 



17. NUMBER OF LESSONS THRU 05-14-93 | j | | 

------------- 

u 
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Pr.p.r.a by g£ S1 QQpy AVAILABLE 



Offica of tha Supar mtenaant 
Dapartmant of Program {valuation (ptf pan) 



